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abstract''' 

' ' Simulation, defined as a representational model of a 

particular theojry, has been the subject cf some research in the 
comzDu'iiication field, but there has been little material published on 
the uses of simulation as a research tool\ Simulations are considered 
helpful in closing gaps between field studies and laboratory 
research, serving to increase ,coherence and consolidate theories. A 
siiDulation will be representative of ^the theory it serves only to the 
extent that it fits a well-constructed, representative model and 
accounts for the interaction of variables consistent with the theory. 
If data froDi a simulation do not support the hypotheses of the 
theory, either the hypotheses or the siraclation should he adjusted 
according to the experimenter Vs goals and his degree of objectivity. 
The validity of simulation must be tested for specific" objectives . 
Many simulations ate more correctly id^^ntified as games or 
metapt^orical extensions of man's social behavior. a.aiportant 
considerations in the use. of games as simulatiops include control of , 
game behavior consistent with the reference system, proper • . 
introduction of subjects to the game activity^ and determination of 
Whether or '*not role, playing behavior best serves the game. (RN) 
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The social scientist has tended to model his research techniques on 
those methods used in the physical and natural sciences. The apparent goal, 
of such modeling has been to achieve precision and exactness often found in 
the physical and, natural sciences. Unfortunately the nature of social ^ 
behavior has, so far, eluded the methodological* efforts by the social scientist. 
Nevertheless, he continues to pursue his goal and sometimes discovers, to 

c 

his embarrassment and to his profession's fembaxxassment, that certain important 
studies are either, i-mpossible to conduct or that certain studies modeled from 
natural science methodologies have yielded absurd and ofteri useless results. 

Research in communication seems particularly vulnerable to these ^problems. 
In spite of some innovative and ingenious efforts, the speech-communication 

field still falls far short of a sufficient scientific methodology capable 

> 

of the powfer found in other sciencJes. Partly as*'a ^result of simple frustration, 
a Considerable segment of the- speech-communicationist * s . efforts have been to 
abandon creative methodolr^i ical alternatives and to turn instead to speculation, 
anecdotal evidence, . and empirical testing under< severely restrictive ^ para- 
digmatic procedures. 

Sessions such as 'this one are heartening because they allow creative 
explorations, of alternative research methodologies that might be conducive 
to ideal social behavior research. In the spirit of creative exploration, 
this paper seeks to discuss some implications of the growing interest in the. 
use of simulations as an alternative research paradigm. The particular 
constraints given to this paper are to identify for the^ speech^ccmmunicatlon 
professional those general problems and iss^ies important in considering- 
simulations for research and to identify, where possible, the resolution 
given those issueg by others. 



The number of scientists involved ditectly or indirectly^n the uae of • 
simulation and gaming ha^e increased dramatically in the last several years. 
Interest and involvement in simulations has increased in the field of 
Speech-communication as well, although not as 'much as one might havo hoped, 
A v^^riety of published articles and papers indicate the use of sijuulations 
and games used as a research tool. The' most ambitious study undertaken by 
a speech-communicatiqja specialist appears to be' the Hylton.and LashbrooK 
attempt to simulate in a man-machine ' operation differen'^ ai.idience^ conditions ' - 
ip a study of saliency in attitude change,"^ Although not identified as a ^ 
simulation^Leathers' experiment involving trust creation and destruction 
, utilized most of the essential characteristics of^a simulation,*'' J^'imilarly, 
Tubbs' study of interpersonal trrust dnd its relation to behavior under 
differing message conditions required a simula^ted condition for manipulating . 
the growth and deterioration of trust behavior. Tubbs used the commonly 
employed Prisoner's Dilemma game as the tesis for his investigation. Qther 
researchers have used the PD game and other aspects of game theory for their ' 
research foundations; Stoinfatt i.ised the PD as a generator for his communi- 
cation study and later with Frye-"^ he again used the PD as a generator in a 
related communication study, Beisecker turned to game theory in general for 
his studies of verbal communication on the outcome of ongoing interactions; 
however, Beisecker' s efforts are prdbably outside of the definition for 
' Simula ti-on, ^ - 

Several articles and papers have devoted their purpose to the <Jiscussion 
of the appropriateness of simulation ^to communication research. The earliest 
and one of the very best efforts was Tucker's discussion of the use for 



simulation Jn the speech field, Kline spoke directly to an issue fdllov^ed 
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xip^heret the difficulty, of achieving isomorphism between simulation^ ar^d 

8 ' 
theory, \ Smith briefly outlined potentials and limitations for research 

9 

in- the speech communication field, Jandt provided a thorough listing of 
appropriate rejerences for anyone interested in si/riulation sources, particularly 

computer simulation,*'* and provided a brief analysis of the appropriateness 

■ - • . 11 • ' 

of simulation in the study of confilict behavior. 



However, some serious shortcomings are evident -within the speech- 
communication fifcld as to the dissemination of useful material about simur 



*la'cions as a research tool. In a casual review of commonly u^ed research 
texts and books published within the field, ncijp contained any substantive / 
reference ^ simulations, with the exception of Emmert and Brookes * short ^^ls« 
cussion-of computer simulations, 

•This ^shortcoming is a little surprising since most- users are quick to 
point out ^that Simula Mens are particularly helpful ^in closing gaps between 
field studies and laboratory research,^ a, particularly essential feature j 
for most thorough communication studies. Furthermore, simulations' can be 
helpfnil in increasing coherence within. and among theories as Well as serving 
to consolidate, pr unite theories, 

A characteristic of simulation that helps yield these advantages is itr 
generally close tie to the original theory. By definition, a .simulation is 

) ■ ^ ■ ' ^ 

a representational model of a particular theory. However because the 
simulatjoi is only representational, it is susceptable to several metho- 
dological questions. The remainder df this paper will pursue some of the 
jnore Important questions, 'i 



Does the simulation represent the theor^ ? . ' . * 

'This may 'seem like a simple and, therefore, unnecessary! question, 

Hpwever, this question poses rather ^serious implication^.. Often 'a simulation. 

is constructed to serve one theory ♦and is currently i^eing.used to serve 

^another theory unrelated- (except possibly in 'a m^ost genei^al way) to tho 

' J- . 

/ ' ♦ 

' original theory. For example, much of the x;esearch using the PD feame 

seems wholly unrelated to the .original theory associated with the PD game 

and wholly unrealistic for the theory being tested. » Stimulations are 

representational of theories and are dependent on thecry for their anax;jisis. 

Whfen isolated from theory or transplanted .i'or use with another theoiy the 

;simulatiQn caQ easily fail to serve the researcher.' Consequently, the 

researcher who 'pirates a. simulation without /lacking an analysis of the 

simulation's a^ropriateness for the research question can obtain absurd . 

results*. 

Kline raises this question by indicating the^ importance in seeking an 
isomorphic relationship between theory and simulation. A step commonly 
forgotten is that, for most therJries, a model ;must be* constructed before 
the simulation is designed, ' From the model a dynamic simulation is constructed 
This means the simulation is a second level representation of the original 
theory and is susceptible to all the compoundtns influences conferred in each 
stage of representation. In all probabilixy, the simulation's approximation 
of the model's approximation of the theory may -yield^ a simulation not 
representative of the theory. Of course, the better the simulation fits 
the model and the m.odel fits the^heory the more clos^ely the simulation will 
be representative of the theory. 



Does the slmulatrlon represent the theory fairly ? 

The previous paragraph relates closelv to this question'. For the simu- 
la t ion to represent the. theory fairly, the simulation must' transcend the model. 
'To do so, the' simulaition most account for the interaciion of variables in the 
same way the theory , accounts for^them, thei simulation's operationalisat icn 
of variabl(*s must be consistent with thg theory, and tne scenario' for -ine , 
sinjulation ;nust a^-low behavior typical of - that behavior referenced by the 
. theory. - • ' j 

The simulation must account for the inteructiofi of variables consistent 
with t-he way /theory or reality accounts for th^ variables, Thi;^ is a diffi- 
cult challenge to meet as should be cl^r ^fter consideration of the next 

<* 

* ^ I. • - • 

question^ The s^ttempt should be to achieve realism in the experimental. 

setting so that the system behaves exactly as its real counterpart/ For 

example, if the theory is deBcri'ptive of behavior, found in collectives then 

the simulation should deal with like collectives.. Although this example 

seems rather straight, forward, a surprising number of research studies do 

not fulfill this consideration. Sufficient research evidence exists to the 

interactive effects fifom group activity that alters the behavioral outcomes 

of individuals. Consequently, .like behavioral condition'o should exist between 

theorv' and simulation. In my own research, I adjust the simulation to' 

account for both group-induced and non-group-induced behavioral patterns as 

• a test for these effect^. 

The operationalization of 'variables is also important in the design of 

c 

' ^ the simulation. Often this is 5. difficult task requiring reconsideration 

ofvthe original theoretical framework. Too often care is not given 'this 

9 . ^ 

essential step* and the datum given, from the simulation proves to be worthless. 



Here is an opportunity to utilize one advantage of simulations — the ability • 
to operationalize certain conditions not normally possible iri other research 
paradigmsl My own research in simulations started specifically as an 
answer to- an inadequacy seen in another-s research with trust. Where others 
were assigning ^levels of trust to subjects I felt it was important for the . 
subje^Dts to internalize those levels of trust. Leathers apparently feels 
the same way since he went to great pains in simulating an enviroiiment for 
creating and destroying levels of trust held by subjects. 

Finally, the simulation cannot represent the theory fairly if the 
scenario does not allow behavior typical of that referenced by the theory. 
The scenario is the context for the model. The construe tioii of the scenario 
has an Inr.ortant influence ox) the behavior within the model. For example, 

13 

a war netting elicits different rtjsponse patterns than a business setting. 
Benson, McMahon, and Sinnreich have written an excellent article on 

scenario design and the important consicJerations that must be 'given to 

Ik ' ' ' 

scenario planning. - ' ' ' <■ 

In any scenario plannin^j the experimenter must face the issue t)f 

mundane realism versus ejcperimental realism. Only the quality and degree 

•of care given the scenario will determine if experimental realism is achieved, 

Drabek and Haas have identified five characteristics necessary for a realistic 

simulation in the study of group behavior. These characteristics a,re useful 

for any researcher to consider r (l) use a te^l group, prefe"rably a natural 

group in a natural setting, that can be manipulated by the experimenter;' 

(2) keep the type of tasl;t, .aptivity, or demand placed on the- group realistic 

and within their capacity; (3) reflect a reasonable ecological setting 

appropriate for this group; ,(^) I^eep the input, information, feedback data, 



etc., at a meanii^i'ful level for the sulpject.o^ and (5) infor.Ti the Gubjects 

that they are participating in an experiment, "^^ This last characteristic 

will be more fully discussed later. The essor.ce of at least four of .these 

> 

characteristics is to respond to John Ker/nedy's statement that . . . pocpl 
start behaving like people only when the jnvirorjnent they are behaving in ha 
•^reality' for them . , . /'"^^ 

Poes the Gimulatj.on serve the t heory , the* e xperimenter , 'or i tself ? 

There is a certain paradox present in any cxperimontol •p^aradi^^m that 
see.Tis to be ^^rticularly obvious with sirniilations, I^/hen the datum .from the 
si.nr.ulation does not support the 'hypotheses or the theory', dges offe ad^iust 
the simulation or the theory? Consider* the more overlooked case of the 
simulation yielding data that does support the hypotheses or theory. Then, 
does the researcher claijii the simulation is isomorphic with the theory? , 
kt .some point the res.Garc}:\er mui^t decide that the simulation answers the 
first two questions and the data supports rejection of the theory or that th 
simulation needs frirther f ine-tui;iing to . yield data supportive of the, theoiy, 

T-'-'ior? , adjusting, modifying the jAmul^tion is a necessary task 
^ ichieving 'a satisfactory aifswer to the first two questions. In fact, ^ 
simulations. offer the advantage of being able to sustain repetitive runs in 
order for the researcher to make adjustments — a condition directly lacking 
in some social research paradigms, Robert A kelson states the^rgunont 
succintly : 

If a simulation could be *'right for the wrong reasons," 
that is, fit the data by virtue of compensating errors, 
then in what st^nse can a good fit be regarded as 
supportive for the theory underlying the. simulation 
model? Can one ever "prove*' a siinulation theory by 
• display inf^ good imitations of particular outcomes? 



. Actually I to Tikni jpulate the sinulation to achieve good L^^itation ?i • ^ 

♦ ^ , ^\ • ' , ' ■ • 

pacrtlCLilar -T^utcoiTies is a partial sacrifice -o? an appropriate advai^tagr- to 

,9' 

using simulation." in the first placo, A^belson has noted that: 5'he sinu- 
lation of a model is iT.:;Gt vrorthv;.jile whe'n^the simulation is ca^.T .'ble of Xjro- 
ducin^ consequences unanticipate J by xhe investi/^ator , 

Another issue closely related to this question i^ the ^xperiinen^er* s 
goals, k•^z\lv^\.\,g tot?l objectivity is inpossibXe', there is alway the issue 
of the simulation operating favorably because of a self-fulfilling propheey.. 
In designing I const, istii.^^, operatirg, testing, and validating the cifiulaticn 
xhere are sufficient opportunities for experimenter bias. The ex lent and 
pervasiveness of such a bias is v^oll documented for other experimental 
paradigms but little attention has been given the dqcumontation of such bias 
for simulation experimpntati/>n. 

Furtherraore, ^he experimenter bias can take other forms r^ateJ to 'jo 
goals oT the simulation project. As has bea^i veil docum.^nted for many* 

r 

soc}.al science research projects outside pres.^ures can *have- pervasive in- 

f luenc 3 on whether the reriearch effort will contribute to the status quo or 

social chan/5e. This is a' part^icularly sensitive issue for communication 

19 

research, particularly in the areas of conflict and persuasion. 

a 

f ■ 

Does the simula.ticn mee t sta-ndards of validity ? 

This q^jestion has been touched on in discussion of the fireceding question. 
It is singled out here to f urther^emphasizo its overridins jTjportance to 
simulation research. Validity is defined as the degree 'of correspondence 
between the model and the reference system, • . ^ 

Hermann'^^ has attempted to identify five approaches to satisfying 
quesripns about validity. He qualifies his approaches b>' noting that each 



- . " . „ ^ 

sljtiulation must face issues of validity c^irectly related to the specifi^'c . 

objectives for'that si/nulaticn. The first validity .test he inentions is 

ihternal validity,^ This is, a test for assuring V^tween-run variance is 

y 

low» Therefore, internal validity is attempted by replications of the ^ 

4 

simulation run. The -second test is for face validity. This is a commonly 
reported validity based on xhe li-npression by the ex'p^irienter, observers, 
or participants that "things are going all right, ''^ This validity is, at be:.^, 
a rough test improved upon by observations stated in advance of what is 

V 

expected and by the experimenter's a^ttempts at objectivity,^ The third 
validity issue is "variable- parameter validity/' Thi^^ test ir. d comparir i 

of * the sinulatioh's variables and para/neters with"- counterparts in the r .i'erenco 

. \ ^ 
system. The fourth validity issue is event validity; This test' _s important 

t6 prediction from the theoi^y for it checks for a comparison between events, 

occurrences, or patterns of beha^^ior occurring in both the rei- i;ence system 

asd the sijnulation. The fifth issue Hermann cutlines is hypoLiiesis validity. 

This is a test for relationships between variables. The test is 'based on 

discovering if systematic differences develop between the hypothesized 

relationship as see*> in the reference , system and the simulation. 

Validation is always a matter of degree. Techniques for testing 
validity issues such as Hermann and other^^ \ v/e advanced are not vevj well 
e5t-abli*shed nor widely uses, Subjectivixy becomes a ruling force and the 
jTiatter of degree accepted tends to widen further and further. 

One of the note common techniques of validity testing is the comparicon 
of the simulation data output; with data output from some other empirical 
test. Recognizing the danger in dealing with output comparisons as mentio^-cd 
"by Abelson, there appears to' be a second iinportant danger^ Since the, 
sftnulation is noi confirmed '^^s being isomorphic with the theory (o'Wierwlse 
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this test is i necessary) then reliance is placed on the coni, j.rativc5 .lata, 
assumed to be the product of a valid met^ jd. This a tenur.-u? assumriion. 
At best the researcher is dealing~with thr^ o issues: (l the .^xt^-nt the 
other empirical method achieves validity with the theory^ (Z) t to extent :.ho 
simulation achieves validity ''with the theory, and (3) the extent *trr> :thor,. • 
enipirical method trelates to the simulation. If sinulation i;: a inlquely 'ton;^ 
ficial social research tool, then the likalihood of th^^^Avd Is^r^e hcU:^ 
resolved is doubtful. In most cases, the uiniulation is exppotp-i' :..o produce^ 
different results, 'hopefully riore sophisticated results,- than c'her methods. 
This sort of validity testing violates thett expectation, 

Does the rnctar^horical use of "games" implv conditi ons not accertabb to tj^ 
theory in quefiti^ n? 

/ 

Kany simuLitions in use today are morfi correctly- defined as gar."s. 
Sir.ae ga;:ic-s i''iply conditions and assumptichs of their own, At becomes 
ap:^ropriatf? to d-al hero wit.'j this special case of slrriulations, 

Ga:r.es, cojii.T.only plavod,- are netaphoricai extensions of man's :)Cclal 

behavior. Thoy serve as "dramatic models of our psychological lives :// - 

21 ' ' 

vidinr, rolr\ar'o of particulp^r tensions," They are used and abur^^i -jy 

p^.rt-.ci pants and spectators as a int^amrof direct and vicarious satisfa-.Tic 

In our liven, f^:l^JOo provide^ a useful function but they do a- more emF-athi : r.ll 

xhar. furdnoientally . 

Consequently, when the concept "game" is brouf/:ht into the laborator^ it 

brings with it, for the participants, qualities that may or may not be a \ 

part of the game's reference sysl -ii, Dy definition, a g.ame is -a^ less com- 

l>lex social. model usually involvlr^ different sides with conflicting Interr-^t 

If the theory 6r reference system does not tolerate behavior consistent with 



metaphorical concepts of the game being used, the research effort is uceless. 

experinenter's handling of certain key paranieters determines "behavior^ 
within the^gaitie. Among the key parameters are; (l) control of payoff 
po^sibilities^and whether they are based cn a zaro-sujn or non-55ero-s*im ' 
oondltionj (2) control 'of rules and requirements necessary for the game 
that are realistic in terms of the reference system; (3) the handling of the 
subjects prior to initiating the game activity'; and (^) whether role-playing' 
behavior or decoption is necessary for the game and whether it is realistic 
for the subjects and valid fpr the reference system. - 

In the discussion of validity, questions couid have been raised about 
tho necessary assumptions required by simulations to operate, in and of 
themselves,. Those questions were deferred for discussion here under a con- 
sideration of games beCc^se they are more obvious with games. Surely the rule 
of behavior in a game must be consistent .With the irules of behavior in the 
reference system. For example, this consistency is particularly important 
if gajne theory serves as a foundation for a research game. If this oonsistcnc, 
is imcomplete or faulty \,hen gaitie theory would be inr -^propriate or misleading 
as a research foundation, / * :/ 

Furthermore, as Drabek and Haas note, the demands made on the subjects 

must be both realistic for the subjects and realistic for the referencie system 

If the behavior is different or complicated for the subjects, the experimenter 

/ 

faces a serious problem. He may not be able to distinguish the subjects' 
behavior in coping .with the different or complex demands from the behavior 
energized by those demands. For example, after working with several hundred 
people in the use of PD-type games, I have come to the conclusion that even 
wheJs^ubjects tell^the experimenter they, are familiar, .knowledgeable, or ' 
otherwise competent with reading and interpreting a payoff matrix (even 
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afti3r the experimenter has explaine^d the natri)^ there will still be a sig- 
nificant number who ate. unable to follow the matrix logic. The result is 
/tor this group of subjects to devote their efforts to* a problem-solving 
behavior conperned with handling the matrix while, concurrently, the experi- 
menter is interpreting the behavior as a^ game-playing behavior. 

Although the ruj.es and requirements mayicall for one particular behavior 
the perception by the subjects of the type of simulation ma.y induce another 
form gf behavior. This seems particularly true. for games. Therefore, the 
^xperijhenter must, be careful in how he handles the subjects prior tD 

initiating the game activity. The possibility for experimenter-inJuced 

22 

bias h^s been documented for learning gaTnes. The^ effect in PD ^ames of 
introducing the two subjects in the dyad as "opponents" or "partners" is 

■it 

known to also affect the subjects' perception of the game. 

The final issue discussed under this question is the perplexing question 
of whether role-playlng behavior or deception best serves the game or sinia- 
lation. There* has been considerable concern expressed recently aboi^t- the use 
of human subjects in experimental research and the effect such experiments ml( 
have on the subjects. Simulations are not immune to this concern particular! 
since one major use of simulation is to alter attitudes of the part ici pant s."" 

Role-playing has been advocated as an alternative to typical deception 

r 

practices. Role-playing is- of i:)articular interest in simulation and gar.o ' 
research since many of the human comj-^onehts in the simulation or game ' / 
correspond to a role or character in the reference system — politician, 
teacher, Nisinessman, diplomat, etc. Again the metaphorical concept of 
gcxme, now with surrogate participants, plays an important part in achieving 
validity. / 
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For the purposes of mo^t decision-making problems, the researcher must 
be cautious to employ roles not dramatically inconsistent with the particular 
subject's own life style or paraneters of behavior. Subjects cannot be 
expected to produce "honest'* behavior patterns consistent for the assigned 
roie if they cannot, under the best of cii^cumstaiices, identify with the 
role.*^ The subject is left with choosing between his own behavior or dis- 
playing a behavior rie thinks is appropriate for his rol'e. Even if the subject 
tells thQ experimentex" he has behaved as he thought the character he played 
would behave, the experimenter does not know if such behavior ls> realistic or 
stereotypic. On the other hand^ if the subject faces one of , these self-role 
incongruencies he might ^.nduce conflict inappropriate for the game, ^ More 

than likely, he will display behavior Inappropriate for either the role or 

25 ■ . 

his self behavior, . ' 

In this brief paper, five basic questions and issues related to them 

have been raised. No claim is made that positive answers to these questions 

will assure research success iiith simulations. For some of these questions 

there are answers and for some there are no answers. As effor^ts are marie to 

cope with these questions simulation will take an appropriate" place with other 

precepted research paradigms as an attractive methodological contribution to 

the study of human communication and human decision-making behavior, Theodore 

Clevenger Identified for the communication specialist the essential value yet 

to be reallsec^ from simulation techniques: 

Simulation is particularly appropriate wherti theory is 
complex and. where direct experimentation on some of the 
variables Is difficult or. Impossible because of the 
dynamic nature of the process. Since it is widely recognized 
that any adequate analysis of communication will prove both 
'^complex and dynamic, it seems likely tnat simulation holds 
the key to future theoretical development In the field and 
thus Kill play a signif^gant'role in the development of 
communication research. 
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